Search processing method and apparatus, device, medium, and program product

ABSTRACT

The present application provides a search processing method performed by a computer device. The method includes: displaying a resource search interface in response to a search operation on multimedia data in a service interface, the resource search interface comprising a first region and a second region; displaying, in the first region, at least one search tag associated with the multimedia data; and displaying, in the second region in response to a selection operation on a target tag of the at least one search tag displayed in the first region, a search result associated with the target tag. Search efficiency for the multimedia data can be improved.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation application of PCT Patent ApplicationNo. PCT/CN2022/113248, entitled “SEARCH PROCESSING METHOD AND APPARATUS,DEVICE, MEDIUM, AND PROGRAM PRODUCT” filed on Aug. 18, 2022, whichclaims priority to Chinese Patent Application No. 202111052525.6,entitled “SEARCH PROCESSING METHOD AND APPARATUS, DEVICE, MEDIUM, ANDPROGRAM PRODUCT” filed with the China National Intellectual PropertyAdministration on Sep. 8, 2021, all of which are incorporated herein byreference in their entirety.

FIELD OF THE TECHNOLOGY

This application relates to the field of computer technologies, and inparticular, to application-program-based information search technology.

BACKGROUND OF THE DISCLOSURE

In many application scenarios (for example, a social conversationscenario, an on-line shopping scenario, or an entertainment scenario), auser may have a requirement of searching for multimedia data in acurrent application scenario. For example, in a scenario in which asocial conversation is made by using a social application program, theuser may have a requirement of searching for multimedia data in a socialconversation interface.

It has been found through practice that in the related art, themultimedia data is required to be manually copied to a search enginewith a search function, to search for the multimedia data. For example,if the multimedia data is an image, when having a requirement ofsearching for the image in the social conversation interface, the userneeds to copy the image to the search engine for searching. This resultsin a long search path and low efficiency of searching for the multimediadata and viewing the multimedia data. Therefore, how to improve searchefficiency of multimedia data has become a hot topic of research.

SUMMARY

Embodiments of this application provide a search processing method andapparatus, a device, a medium, and a program product, which can improvesearch efficiency for multimedia data.

In an aspect, an embodiment of this application provides a searchprocessing method, performed by a computer device. The method includes:

-   -   displaying a resource search interface in response to a search        operation on multimedia data in a service interface, the        resource search interface comprising a first region and a second        region;    -   displaying, in the first region, at least one search tag        associated with the multimedia data; and    -   displaying, in the second region in response to a selection        operation on a target tag of the at least one search tag        displayed in the first region, a search result associated with        the target tag.

In another aspect, this application provides a computer device. Thecomputer device includes:

-   -   a processor, configured to load and execute a computer program;        and    -   a computer-readable storage medium storing the computer program.        The computer program, when executed by the processor, causes the        computer device to implement the foregoing search processing        method.

In an aspect, this application provides a non-transitorycomputer-readable storage medium. The computer-readable storage mediumstores a computer program. The computer program, when executed by theprocessor, causes the computer device to implement the foregoing searchprocessing method.

In an aspect, this application provides a computer program product orcomputer program. The computer program product or computer programincludes computer instructions. The computer instructions are stored ina computer-readable storage medium. A processor of a computer devicereads the computer instructions from the computer-readable storagemedium. The computer instructions are executed by the processor toimplement the foregoing search processing method.

In this embodiment of this application, the search operation may betriggered for the multimedia data on the service interface, and theresource search interface may be displayed. The at least one search tagassociated with the multimedia data and the search result associatedwith the target tag are displayed on the resource search interface. Inthe foregoing solution, the search operation may be directly triggeredfor the multimedia data displayed on the service interface to obtain thesearch tag associated with the multimedia data and the search resultassociated with the target tag. This simplifies a search process of themultimedia data, shortens a search path, and improves the searchefficiency.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 a is a schematic diagram of an image according to an embodimentof this application.

FIG. 1B is a schematic diagram of a search processing scenario accordingto an embodiment of this application.

FIG. 2 is a schematic flowchart of a search processing method accordingto an embodiment of this application.

FIG. 3 a is a schematic diagram of a thumbnail of an image according toan embodiment of this application.

FIG. 3 b is a schematic diagram of displaying an image on full screen ona content display interface according to an embodiment of thisapplication.

FIG. 3 c is a schematic diagram of triggering a content displayinterface to be displayed through a social conversation interfaceaccording to an embodiment of this application.

FIG. 4 a is a schematic diagram in which a service interface is a socialconversation interface according to an embodiment of this application.

FIG. 4 b is a schematic diagram in which a service interface is acontent display interface according to an embodiment of thisapplication.

FIG. 5 is a schematic diagram of a resource search interface accordingto an embodiment of this application.

FIG. 6 is a schematic flowchart of a search processing method accordingto an embodiment of this application.

FIG. 7 a is a schematic diagram of a search object window according toan embodiment of this application.

FIG. 7 b is a schematic flowchart of performing search on multimediadata when a search application object is a search applet according to anembodiment of this application.

FIG. 8 is a schematic flowchart of triggering a target search resultaccording to an embodiment of this application.

FIG. 9 is a schematic diagram of sharing a search identifier of a targetsearch result to a social conversation interface in a socialconversation message form according to an embodiment of thisapplication.

FIG. 10 a is a schematic diagram of a search processing scenarioaccording to an embodiment of this application.

FIG. 10 b is a schematic diagram of a search processing scenarioaccording to an embodiment of this application.

FIG. 11 a is a schematic diagram of an architecture of a searchprocessing system according to an embodiment of this application.

FIG. 11 b is a schematic flowchart of a search processing methodaccording to an embodiment of this application.

FIG. 11 c is a schematic diagram of an architecture of a recognitionalgorithm according to some embodiments of this application.

FIG. 12 is a schematic diagram of a structure of a search processingapparatus according to an embodiment of this application.

FIG. 13 is a schematic diagram of a structure of a search processingapparatus according to an embodiment of this application.

FIG. 14 is a schematic diagram of a structure of a computer deviceaccording to an embodiment of this application.

DESCRIPTION OF EMBODIMENTS

The technical solutions in the embodiments of this application will bedescribed clearly and completely below with reference to the drawings inthe embodiments of this application. Clearly, the described embodimentsare not all but only some embodiments of this application. All otherembodiments obtained by a person of ordinary skill in the art based onthe embodiments of this application without creative work shall fallwithin the protection scope of this application.

The embodiments of this application involve multimedia data. Themultimedia data may include but is not limited to an animation, audio,an image, a text, a video, a rich text, or the like. The following usesan example in which the multimedia data is an image for description,unless particularly noted. The image generally includes one or moreimage elements. FIG. 1 a is an exemplary schematic diagram of the imageand the image element in the image. As shown in FIG. 1 a , an image 101includes a person 1011, a skateboard 1012, a bird 1013, and a hat 1014.In the embodiments of this application, each object in the image 101 maybe referred to as an image element. That is, image elements in the image101 are the person 1011, the skateboard 1012, the bird 1013, and the hat1014. Image recognition may be performed on the image to obtain imagecontent, image attribute information, and the like of the image. Theimage may be analyzed better based on the image content and the imageattribute information of the image. The image content may include theimage element in the image, a meaning of the image (for example, ameaning of the image shown in FIG. 1 a is a skateboarding boy), or thelike. The image attribute information may include information of pixels,a size, a source, an address, and the like of the image.

The multimedia data (for example, an image) may be displayed on aservice interface provided by a target application program. The targetapplication program can obtain the multimedia data, and supportstriggering of data search. An application program is a computer programcompleting one or more specific functions. The application program maybe classified according to different dimensions (for example, anoperation mode or a function of the application program) to obtain typesof the same application program in different dimensions. For example,(1) when classified according to the operation mode of the applicationprogram, the application may include but is not limited to a clientinstalled in a terminal, an applet available without download andinstallation, a web application program opened through a browser, andthe like. (2) When classified according to a function type of theapplication program, the application program may include but is notlimited to an instant messaging (IM) application program, a contentinteraction application program, and the like. The IM applicationprogram is an application program for Internet-based instant messageexchange and social interaction. The IM application program may includebut is not limited to a social application program with a communicationfunction, a map application program with a social interaction function,a game application program, and the like. The content interactionapplication program is an application program capable of implementingcontent interaction, and may be, for example, on-line banking, a sharingplatform, a personal space, news, or another application program. A typeof the target application program is not limited in the embodiments ofthis application.

In the embodiments of this application, searching may be directlyperformed on the multimedia data displayed on the service interface ofthe target application program to obtain a search result associated withthe multimedia data. For example, searching is performed on an image(that is, the multimedia data) displayed on a social conversationinterface (that is, an interface for displaying a social conversationmessage sent by a user participating in a social conversation) in thetarget application program (for example, an IM application program) toobtain a search result associated with the image. The search result mayspecifically be associated with one or more image elements in the image,for example, an image element “puppy” in the image. In this case, thesearch result associated with the image may include the found imageincluding the image element “puppy”. Based on the descriptions of theabove related content, the embodiments of this application propose asearch processing solution. In the search processing solution, a searchoperation is performed on multimedia data displayed on a serviceinterface, and one or more search tags associated with the multimediadata and a search result associated with a target tag are displayed on aresource search interface. In this way, the search operation may bedirectly performed on the multimedia data displayed on the serviceinterface. This simplifies a search process of the multimedia data,shortens a search path, and improves search efficiency.

The foregoing search processing solution may be performed by a targetterminal, specifically performed by a target application program run inthe target terminal. The target terminal may be any terminal. Theterminal may include but is not limited to a device such as a smartphone(for example, an Android mobile phone or an iOS mobile phone), a tabletcomputer, a personal computer, a portable personal computer, a mobileInternet device (MID), a smart television, an in-vehicle device, or ahead-mounted device. A type of the terminal is not limited in theembodiments of this application.

FIG. 1B is an exemplary schematic diagram of a search processingscenario. As shown in FIG. 1B, it is assumed that the target terminal isa terminal 102 used by a target user (for example, any user) with animage (that is, multimedia data) search requirement, a socialapplication program is run in the terminal 102, and the target user mayparticipate in a social conversation through the social applicationprogram run in the terminal 102. Specifically, the target user may sendor read a social conversation message through any social conversationinterface in the social application program, to participate in thesocial conversation. The social conversation interface includes a socialconversation message flow. The social conversation message flow includesa social conversation message sent by at least one user participating inthe social conversation. If the social conversation interface includesmultimedia data displayed in a social conversation message form, aresource search interface may be displayed in response to a searchoperation for the multimedia data. The resource search interfaceincludes one or more search tags (for example, a search tag 1022)associated with the multimedia data and a search result associated witha target tag (for example, a search result 1023 associated with thesearch tag 1022) in the one or more search tags. Based on the abovedescriptions, it can be seen that, in the embodiments of thisapplication, both the interfaces for displaying the multimedia data andthe search result belong to the social application program. That is,application program switching and jumping (for example, manually copyingan image from the social application program to a search application forsearching) are avoided in a search process of the multimedia data. Thissimplifies the search process of the multimedia data, shortens a searchpath, improves search efficiency, and realizes a search function of thesocial application program.

The above uses an example in which the target application program is thesocial application program and the service interface is the socialconversation interface in the social application program fordescription. However, in a practical application scenario, the serviceinterface may alternatively be a social public service interface, forexample, a trends interface or Moments, in the social applicationprogram. The multimedia data may be a piece of social information in asocial information flow in the social public service interface. Thesocial information flow may be a feed flow, an information flow that iscontinuously updated and presents social information to the user.Alternatively, the service interface may be a preview interface of themultimedia data. The preview interface may be used for displayingdetails of the multimedia data, or the like. Types and styles of thetarget application program and the service interface in the targetapplication program are not limited in the embodiments of thisapplication.

Based on the foregoing search processing solution, an embodiment of thisapplication proposes a more specific search processing method. Thefollowing describes the search processing method proposed in thisembodiment of this application in detail with reference to the drawings.

FIG. 2 is a schematic flowchart of a search processing method accordingto an exemplary embodiment of this application. The search processingmethod may be performed by a target terminal (for example, anyterminal). The search processing method may include but is not limitedto steps S201 to S204:

S201: Display multimedia data on a service interface.

When a target user opens and uses a target application program (forexample, a social application program), the target terminal may displaythe service interface in the target application program. According todifferent types of target application programs, the target applicationprograms include different service interfaces. Alternatively, a sametarget application program includes different service interfaces. Forexample, if the target application program is the social applicationprogram, a service interface of the social application program mayinclude a social conversation interface for implementing a socialconversation, a social public service interface for displaying a socialinformation flow (for example, a feeds flow), a preview interface forpreviewing the multimedia data, an information setting interface forsetting user information (for example, information of a user account, auser nickname, or a user portrait) of the target user (for example, auser of the target terminal), . . . , and the like. For ease ofdescription, an example in which the application program is the socialapplication program and the service interface of the social applicationprogram is respectively the social conversation interface forimplementing the social conversation and the preview interface forpreviewing the multimedia data is used for description in thisembodiment of this application. In this embodiment of this application,the preview interface for previewing the multimedia data is referred toas a content display interface.

The above describes several service interfaces of the social applicationprogram. The following briefly describes an implementation of displayingthe multimedia data on each service interface.

(1) The service interface is the social conversation interface. Thesocial conversation interface is used for displaying a socialconversation message flow of a plurality of users participating in thesocial conversation. In this case, when the multimedia data is displayedon the social conversation interface in a social conversation messageform, a resource search interface may be displayed in response to asearch operation triggered for the multimedia data on the socialconversation interface. Specifically, the multimedia data includesgeneral information of the multimedia data. That is, the generalinformation of the multimedia data may be displayed on the socialconversation interface (for example, the service interface). Thefollowing describes the general information of the multimedia data withexamples. For example, the multimedia data is a text. The text includesa document icon of the text, that is, general information of the text isthe document icon, and in this case, the text may be displayed on thesocial conversation interface in a document icon form. Alternatively,the text includes summary information (for example, title information orkey information extracted from the text) of the text, that is, generalinformation of the text is the summary information, and in this case,the text may be displayed on the social conversation interface in asummary information form. The text is a written representation form. Thetext may include one or more characters. The one or more characters forma character string. The character may include at least one of thefollowing: a Chinese character (that is, a Chinese character), anEnglish character (that is, a letter), a number, and a punctuation mark(for example, a comma “,”, a full stop “.”, or square brackets “[ ]”).For another example, the multimedia data is an image. The image includesa thumbnail of the image, that is, general information of the image isthe thumbnail, and in this case, the image may be displayed on thesocial conversation interface in a thumbnail form. FIG. 3 a is anexemplary schematic diagram of displaying the thumbnail of the image onthe social conversation interface of the social application program. Asshown in FIG. 3 a , the social conversation interface 301 is displayedin the social application program. The social conversation interface 301is a conversation interface for bearing a social conversation between auser A and the target user. The social conversation interface 301includes a social conversation message flow 302. The social conversationmessage flow 302 includes a social conversation message 3021 and asocial conversation message 3022. The social conversation message 3022is a thumbnail of an image. The thumbnail may be understood as beingobtained by scaling down the image.

(2) The service interface is the content display interface. The contentdisplay interface may be referred to as the preview interface. When theservice interface of the social application program is the previewinterface of the multimedia data, a resource search interface may bedisplayed in response to a search operation triggered for the multimediadata on the social conversation interface. Specifically, the multimediadata includes data content of the multimedia data. That is, the datacontent of the multimedia data is displayed on the content displayinterface. The following describes the data content of the multimediadata with examples. For example, the multimedia data is a text. The textincludes a character string, that is, data content of the text is thecharacter string in the text, and in this case, all or part of thecharacter string in the text is displayed on the content displayinterface. That is, the content display interface is used for displayingtext details of the text. For another example, the multimedia data is animage. The image may be displayed on full screen. In this case, datacontent of the image is the image displayed on full screen. That is, theimage may be displayed on full screen on the content display interface.FIG. 3 b is an exemplary schematic diagram of displaying the image onfull screen on the content display interface. As shown in FIG. 3 b , acontent display interface 303 is displayed in the social applicationprogram. The image is displayed on full screen on the content displayinterface 303. That is, a display size of the image matches an interfacesize of the content display interface (for example, the sizes are thesame, or a difference between the sizes is less than a presetdifference). In this case, the data content of the image may include theimage displayed on full screen.

(1) In this embodiment of this application, the content displayinterface of the multimedia data is triggered to be displayed based onthe social conversation interface of the social application program. Inother words, the social conversation message 3022 on the socialconversation interface 301 shown in FIG. 3 a may be triggered to triggerthe content display interface 303 shown in FIG. 3 b to be displayed. Animage obtained by scaling up the image in the social conversationmessage 3022 is displayed on the content display interface 303. FIG. 3 cis a schematic diagram of an interface process in the foregoingimplementation. As shown in FIG. 3 c , after the social conversationmessage 3022 is triggered on the social conversation interface 301, thecontent display interface 303 is displayed. A trigger operation for thesocial conversation message 3022 on the social conversation interface301 may include but is not limited to a gesture operation (for example,tapping, dragging, or touching and holding), a voice input operation, avibration operation (for example, shaking a mobile phone), and the like.In addition, the content display interface may alternatively betriggered to be displayed based on another service interface in thesocial application program, for example, the social public serviceinterface (for example, Moments) in the social application program. Whenthe multimedia data is displayed on the social public service interface(for example, the multimedia data is displayed in a social message flowform), the search operation for the multimedia data may be directlytriggered on the social public service interface, or the content displayinterface is triggered to be displayed on the social public serviceinterface, thereby triggering the search operation for the multimediadata on the content display interface.

(2) The social conversation interface mentioned in this embodiment ofthis application may include a conversation interface between the targetuser and another user (for example, a user who is a friend, a colleague,or a stranger for the target user). The social conversation interfacemay further include a conversation interface between the target user andthe social application program. In other words, an intelligent robot maybe deployed in the social application program. During a socialconversation between the target user and the intelligent robot, thetarget user may send the multimedia data, and the intelligent robot mayreceive the multimedia data sent by the target user, and return a searchtag and a search result that are associated with the multimedia data.Certainly, the intelligent robot may alternatively be deployed on asocial conversation interface between the target user and another user,and during a social conversation, the intelligent robot is aroused toperform search on the social conversation interface. (3) The foregoingimplementations are described by using an example in which the targetapplication program is the social application program and the serviceinterface is an interface in the social application program. However, itmay be understood that the target application program may be anothertype of target application program. For example, the target applicationprogram is a map application program, a game application program, or acamera application program. Accordingly, the service interface is aninterface (for example, a map display interface) in the map applicationprogram, or the like. A type of the target application program and astyle of the service interface are not limited in this embodiment ofthis application.

S202: Display a resource search interface in response to a searchoperation on the multimedia data in a service interface.

As described above, the service interface of the target applicationprogram may include a plurality of types. For example, the serviceinterface of the social application program includes the socialconversation interface and the content display interface.Implementations of triggering the search operation performed on themultimedia data on different types of service interfaces are different.The following uses an example in which the service interface is thesocial conversation interface or the service interface is the contentdisplay interface and the multimedia data is an image to describeimplementations of triggering the search operation to be performed onthe multimedia data on the service interface and triggering the resourcesearch interface to be displayed.

(1) The service interface is the social conversation interface. Thesocial conversation interface includes the multimedia data displayed inthe social conversation message form. In this implementation, animplementation of displaying the resource search interface in responseto the search operation on the multimedia data in a service interfacemay include: displaying an option bar on the social conversationinterface in response to a trigger event for the multimedia data on thesocial conversation interface, the option bar including a search option;and determining, in response to detecting a selection operation on thesearch option in the option bar, that the search operation for themultimedia data is generated, and displaying the resource searchinterface. The trigger event may include but is not limited to an eventgenerated by performing a trigger operation (for example, a tapping,double-click, or right-click operation) on the multimedia data on thesocial conversation interface, an event generated in response todetecting existence of the multimedia data on the social conversationinterface, an event generated in response to detecting on the socialconversation interface that a cursor (for example, a cursor mapped by adevice such as a stylus, a remote controller, or a mouse on a displayscreen) is in a display region in which the multimedia data is, and thelike. An implementation in which the trigger event may be generated inresponse to detecting, on the social conversation interface, themultimedia data or existence of the cursor in the display region inwhich the multimedia data is may prompt the target user to some extentthat searching may be performed on the multimedia data. In summary, inthis embodiment of this application, the search operation for themultimedia data on the social conversation interface may be performeddirectly on the social conversation interface.

If the multimedia data includes general information of the multimediadata, the general information of the multimedia data is displayed on thesocial conversation interface. In this case, the trigger event for themultimedia data on the social conversation interface may be a triggerevent for the general information of the multimedia data on the socialconversation interface. FIG. 4 a is an exemplary schematic flowchart ofperforming the search operation on the general information of themultimedia data on the social conversation interface and displaying theresource search interface. As shown in FIG. 4 a , it is assumed that theservice interface is the social conversation interface 301. A thumbnail(that is, the social conversation message 3022) of an image displayed inthe social conversation message form is displayed on the socialconversation interface 301. When the thumbnail of the image is triggered(for example, tapped, double-clicked, or touched and held), an optionbar 401 may be displayed on the social conversation interface 301. Theoption bar 401 includes one or more options, for example, includes asearch option 4011, a copy option, and a scale-up option. If the searchoption 4011 in the option bar 401 is selected, it is determined that asearch operation for the image is generated, which indicates that thetarget user wants to search for the image, and a resource searchinterface 402 is displayed.

(2) The service interface is the content display interface. Themultimedia data is displayed on the content display interface. In thisimplementation, an implementation of displaying the resource searchinterface in response to the search operation on the multimedia data ina service interface may include: the content display interface includinga search control (or referred to as a search component or the like),outputting a sharing window in response to a selection operation on thesearch control on the content display interface, the sharing windowincluding a search option; and determining, in response to detecting aselection operation on the search option in the sharing window, that thesearch operation for the multimedia data is generated, and displayingthe resource search interface. That is, in this embodiment of thisapplication, the search operation for the multimedia data may bedirectly triggered on the preview interface (that is, the contentdisplay interface) of the multimedia data.

If the multimedia data includes the data content of the multimedia data,the data content of the multimedia data is displayed on the contentdisplay interface. The search operation on the multimedia data in aservice interface may be a search operation triggered for the datacontent of the multimedia data on the content display interface. FIG. 4b is an exemplary schematic flowchart of performing the search operationon the data content of the multimedia data on the content displayinterface and triggering the resource search interface to be displayed.As shown in FIG. 4 b , it is assumed that the service interface is thecontent display interface 303, the multimedia data is an image, and theimage is displayed on full screen on the content display interface 303.The content display interface 303 includes a search control 403. Whenthe search control 403 is touched, a sharing window 404 is triggered tobe displayed. The sharing window 404 includes one or more options, forexample, includes a search option 4041. When the search option 4041 istouched, it is determined that a search operation for the image istriggered, which indicates that the target user wants to search for theimage, and a resource search interface 402 is displayed.

The above is merely two exemplary implementations of triggering thesearch operation for the multimedia data. The social conversationinterface 301 and the option bar 401 in FIG. 4 a and the content displayinterface 303 and the sharing window 404 in FIG. 4 b are all exemplary.For example, in addition to overlaying the content display interface303, the sharing window 404 shown in FIG. 4 b may be displayed in a formof an independent interface. Display styles and display positions ofeach interface, window, and control are not limited in this embodimentof this application.

Based on the above implementations of triggering the resource searchinterface to be displayed, it can be seen that, in this embodiment ofthis application, the search operation for the multimedia data on thesocial conversation interface may be triggered directly on the socialconversation interface, and the multimedia data is not required to becopied and transferred. Therefore, the search operation is simplified,and search efficiency is improved.

S203: Display, in a first region, at least one search tag associatedwith the multimedia data.

S204: Display, in a second region in response to a selection operationon a target tag of the at least one search tag displayed in the firstregion, a search result associated with the target tag.

In steps S203 and S204, when the target user has a requirement ofsearching for the multimedia data displayed on the service interface,the target user may trigger the search operation for the multimedia dataon the service interface. Then, the target terminal may display theresource search interface in response to the search operation on themultimedia data in a service interface. The resource search interface isan interface for displaying one or more search tags associated with themultimedia data and the search result associated with the target tag inthe one or more search tags. The one or more search tags associated withthe multimedia data and the search result associated with the target tagare both obtained by performing search processing based on themultimedia data. The above-mentioned target tag may be a default searchtag (for example, any one of the one or more search tags), or a tagselected by the target user on the resource search interface. This isnot limited in this embodiment of this application.

The resource search interface includes a result display region fordisplaying the search result. The result display region includes thefirst region and the second region. Further, the first region of theresult display region is used for displaying the one or more search tagsassociated with the multimedia data. The second region of the resultdisplay region is used for displaying the search result associated withthe target tag. The target tag may be a tag selected in response to theselection operation triggered for the search tag displayed in the firstregion. That is, the target tag is a selected search tag in the firstregion. In some embodiments, the resource search interface may furtherinclude the display region for displaying the multimedia data. That is,the multimedia data for which the search operation is triggered isdisplayed in the display region on the resource search interface.

The following describes an exemplary schematic diagram of the resourcesearch interface with reference to FIG. 5 . As shown in FIG. 5 , (1) theresource search interface 402 includes a display region 4021 fordisplaying the multimedia data. The display region 4021 is used fordisplaying the multimedia data. For example, if the multimedia data isan image, the display region 4021 may be used for displaying a thumbnailof the image, or the like. (2) The resource search interface 402 furtherincludes a result display region 4022 for displaying the search result.The result display region 4022 includes a first region 40221 and asecond region 40222.

(1) The first region 40221 is used for displaying the one or more searchtags associated with the multimedia data. According to different typesof multimedia data, the multimedia data is in different associationrelationships with a search tag. For example, if the multimedia data isan image, recognition processing may be performed on the image to obtaina key word associated with the image (for example, the keyword mayindicate an image element in the image), and then the keyword of theimage may be determined as a search tag. That is, an associationrelationship between an image and a search tag of the image may beembodied as follows: the search tag of the image may be used forindicating an image element in the image. For another example, if themultimedia data is a text, the text including one or more characterstrings, text recognition may be performed on the text to extract akeyword of the text, and then the keyword of the text may be determinedas a search tag associated with the text. That is, an associationrelationship between a text and a search tag of the text may be embodiedas follows: the search tag of the text may be used for indicating keycontent (for example, a title or a word for expressing a main idea ofthe text) of the text.

(2) The second region 40222 is used for displaying the search resultassociated with the target tag. After any search tag (for example, thetarget tag) in the first region 40221 is selected, a search resultassociated with the selected search tag may be displayed in the secondregion 40222. The search result is obtained by performing search basedon the search tag. For example, if the selected target tag in the firstregion 40221 is “Xiaoming”, the search result that is displayed in thesecond region 40222 and that is associated with the target tag is about“Xiaoming”. In addition, the selected target tag may be highlighted inthe first region 40221. A highlighting manner may include highlighting,color displaying, and the like. For example, highlighting means that aregion occupied by the target tag is displayed with brightness higherthan that of another search tag. Color displaying means that a font ofthe target tag is displayed in a color different from that of a font ofanother search tag.

In addition, if the selected target tag is switched in the first region40221, switching may be accordingly performed to display a correspondingsearch result in the second region 40222. Refer back to FIG. 5 . Acurrently selected search tag in the first region 40221 is a tag 403,and a search result associated with the tag 403 is displayed in thesecond region 40222. When a tag switching operation is performed in thefirst region 40221, for example, switching is performed in the firstregion 40221 to select a tag 404, the search result associated with thetag 403 is replaced with a search result associated with the tag 404 inthe second region 40222.

A search tag may be selected by default in the first region on theresource search interface displayed in response to the search operationon the multimedia data in a service interface. In this case, the searchtag selected by default is the target tag. A search result associatedwith the search tag is displayed by default in the second region. Inthis way, the target user may be prompted to some extent to switch thesearch tag to obtain search results associated with different searchtags. Which search tag is selected by default is not limited in thisembodiment of this application. For example, a plurality of search tagsmay be ranked according to a ranking rule, and a search tag arranged ata first position may be determined as the target tag. For an image, theranking rule may include determining a target tag according to a displayarea of the image occupied by an image element indicated by a keywordcorresponding to a search tag. If the display area occupied by the imageelement is larger, the search tag indicated by the keyword correspondingto the image element is arranged closer to the front, and a search tagwith a largest display area (that is, arranged at a first position) maybe determined as the target tag selected by default. Certainly, theabove is merely one ranking rule for an image. A specific implementationof the ranking rule is not limited in this embodiment of thisapplication.

In this embodiment of this application, the search operation may betriggered for the multimedia data on the service interface, and theresource search interface may be displayed. The at least one search tagassociated with the multimedia data and the search result associatedwith the target tag are displayed on the resource search interface. Inthe foregoing solution, the search operation may be directly triggeredfor the multimedia data displayed on the service interface to obtain thesearch tag associated with the multimedia data and the search resultassociated with the target tag. This simplifies a search process of themultimedia data, shortens a search path, and improves the searchefficiency.

FIG. 6 is a schematic flowchart of a search processing method accordingto an exemplary embodiment of this application. The search processingmethod may be performed by a target terminal (for example, anyterminal). The search processing method may include but is not limitedto steps S601 to S607:

S601: Display multimedia data on a service interface.

A specific implementation process of step S601 may refer to relateddescriptions about a specific implementation process of step S201 in theembodiment shown in FIG. 2 , and will not be elaborated herein.

S602: Display a search object window in response to a search operationon the multimedia data in a service interface.

S603: Determine, in response to a selection operation performed in thesearch object window, M target object identifiers in an objectidentifier of at least one search application object displayed in thesearch object window, and trigger search application objects indicatedby the M target object identifiers to perform search processing.

In steps S602 and S603, in this embodiment of this application, a targetuser may select a search application object for performing searchprocessing on the multimedia data. The search application object is asearch application (or referred to as a search engine) with a searchfunction. An object identifier of the search application object is awebsite of the search application object, an icon through which thesearch application object may be linked, or the like. The searchapplication object may be called to perform search processing on themultimedia data.

In some embodiments, the search application object may be a third-partysearch application with a search function. The search application objectis bound with the above-mentioned target application program. In thiscase, when there is the search operation for the multimedia data in thetarget application program, the search application object bound with thetarget application program may be called to search for the multimediadata. Compared with an existing manner in which the search applicationobject is started after the multimedia data is downloaded through thetarget application program and then the multimedia data is copied to thesearch application object for searching, this embodiment of thisapplication has the advantages that a client is not required to berestarted, traffic is reduced, the search operation is simplified, and asearch speed is increased. Alternatively, the search application objectmay be an applet (or referred to as a search applet) that is deployed(or run) in a target application program and that has a search function.In this case, the target application program may directly search for themultimedia data by using the applet. When search is performed on themultimedia data in this way, the applet may be opened fast to performthe search operation, the search operation may be simplified,development costs of the target application program may be reduced, andsearch efficiency may be improved. Alternatively, the search applicationobject may be a search function provided by a target applicationprogram. That is, the search application object is the search functiondeployed in the target application program. That is, the targetapplication program has the search function. In this case, the targetapplication program may directly perform search processing on themultimedia data. Therefore, the search operation is simplified, andsearch efficiency is improved.

In specific implementations, performing the selection operation on anobject identifier of any one or more search application object in thesearch object window indicates that the target user wants to use thesearch application object indicated by the selected object identifier toperform search processing on the multimedia data. Therefore, an obtainedsearch result about the multimedia data is obtained through search withthe search application object indicated by the selected objectidentifier. The following describes an exemplary schematic diagram ofthe search object window with reference to FIG. 7 a . As shown in FIG. 7a , a search object window 701 is displayed in response to the searchoperation on the multimedia data in a service interface. The searchobject window 701 includes an object identifier of at least one searchapplication object, for example, an object identifier of a searchapplication object 1 and an object identifier of a search applicationobject 2. The target user may select M target object identifiers fromthe search object window 701, M being a positive integer, whichindicates that the target user wants to use search application objectsindicated by the selected M target object identifiers to perform thesearch operation. Step S604 is triggered in response to detecting thatselection of the target object identifiers is completed. It may beunderstood that the object identifier displayed in the search objectwindow may include both the object identifier of the search applicationobject and an object identifier of the search function provided by thetarget application program. This is not limited in this embodiment ofthis application.

In an implementation in which the search application object is a searchapplet, an implementation process in which the search applet istriggered to perform search processing on the multimedia data on aservice interface of the target application program may include:displaying a search object window of the target application program inresponse to the search operation for the multimedia data on the serviceinterface of the target application program, the search object windowincluding an object identifier of one or more search applets, where thesearch object window may certainly further include an object identifierof a third-party search application with the search function;triggering, in a case that a selection operation is performed in thesearch object window and a search applet is selected from the searchobject window through the selection operation, the search applet toperform search processing; and triggering a search interface of thesearch applet to be displayed after the search applet completes searchprocessing on the multimedia data, the search interface including asearch tag obtained by the search applet by searching for the multimediadata and a search result associated with the search tag.

The following briefly describes, with reference to FIG. 7 b , a processin which searching is performed on the multimedia data through thesearch applet. As shown in FIG. 7 b , when there is the search operationfor the multimedia data on the service interface of the targetapplication program, if the service interface is a social conversationinterface shown in FIG. 7 b , and the multimedia data is displayed onthe social conversation interface in a thumbnail form, the search objectwindow may be triggered to be displayed according to the searchoperation. The object identifier of the search application object isdisplayed in the search object window. For example, the objectidentifier of the search applet (for example, an object identifier of asearch applet 1 shown in FIG. 7 b ) is displayed in the search objectwindow. When the object identifier of the search applet 1 is selected,it indicates that the target user wants to use the search applet 1 tosearch for the multimedia data. In this case, a search interface 702 ofthe search applet 1 is triggered to be displayed. The search tagobtained by the search applet 1 by searching for the multimedia data anda search result associated with the search tag are displayed on thesearch interface 702. Therefore, search is directly performed on themultimedia data in the target application program. In the foregoingimplementation, the search applet is run in the target applicationprogram. In this way, the target application program may directly searchfor the multimedia data by using the search applet. Compared withdeployment of a search entry of another application program in thetarget application program and jumping from the target application toanother search application object with the search function forsearching, the foregoing implementation has the advantages that thesearch applet may be opened fast to perform the search operation, thesearch operation may be simplified, development costs of the targetapplication program may be reduced, and search efficiency may beimproved.

In some embodiments, a search box 7021 may be set in the searchinterface 702 of the search applet 1 in FIG. 7 b , such that the targetuser triggers search for other content through the search box 7021. Inthis implementation, when the target user has another search requirementduring use of the target application program, the search applet may beopened in the target application program for searching. This avoidsjumping from the target application program to another applicationprogram for searching, improves user experience, and increases aretention rate of the target application program. Certainly, a specificstyle and function setting of the search interface 702 of the searchapplet 1 may be set as practically required. The search interface 702shown in FIG. 7 b is merely an exemplary interface style.

In addition, in this embodiment of this application, when there is thesearch operation for the multimedia data in the target applicationprogram, searching may be performed on the multimedia data by using adefault target search applet (for example, any search applet), and thesearch tag and the search result that are obtained by the target searchapplet through searching are displayed on a resource search interface ofthe target application program. Certainly, an object identifier of thetarget search applet may further be displayed on the resource searchinterface of the target application program, to prompt the target userthat content on the current resource search interface is obtained by thetarget search applet through searching. Alternatively, after searchingis performed on the multimedia data by using the default target searchapplet (for example, any search applet), a search interface of thetarget search applet may be directly displayed, to prompt the targetuser that the search result is obtained by the target search appletthrough searching. In the foregoing solution, a process in which thetarget user selects the object identifier is eliminated, a searchprocess may be shortened to some extent, and the search efficiency isimproved.

An object identifier of another search applet may further be displayedon the resource search interface of the target application program.Alternatively, an object identifier of another search applet may furtherbe displayed on the search interface of the target search applet. Forexample, the object identifier of the another search applet is displayedon the search interface of the target search applet in a floatingmanner. This helps the target user select the another search applet tosearch for the multimedia data, meets a requirement of the target userfor selecting a search application object, and supports a permission ofthe target user to select the search application object.

After the resource search interface is triggered to be displayed basedon the selection operation performed by the target user in the searchobject window, in this embodiment of this application, the search tagfor indicating the M target object identifiers is displayed in a firstregion. That is, in this implementation, the search tag displayed in thefirst region corresponds to the target object identifier. Specifically,each of at least one search tag displayed in the first regioncorresponds to a search application object indicated by one of the Mtarget object identifiers. Search application objects indicated bydifferent target object identifiers in the M target object identifierscorrespond to different search tags. In brief, the search tag displayedin the first region of the resource search interface is incorrespondence to the M target object identifiers (or a searchapplication object indicated by each target object identifier). As shownin FIG. 7 a , each search tag displayed in the first region indicates atarget object identifier. When any search tag is selected, a searchresult that is displayed in a second region and that is associated withthe any search tag is obtained by a search application object indicatedby a target object identifier corresponding to the any search tagthrough searching. In this implementation, the search result associatedwith the multimedia data is from the search application object selectedby the target user, and a requirement of the target user forindependently selecting the search application object is met.

The above-mentioned search application object is a search applicationfor performing search processing on the multimedia data. The searchresult about the multimedia data may be obtained by the searchapplication object through searching. The search result may include butis not limited to content in a form of information, an article,audio/video, an animation, an image, and the like. A bearer of thesearch result may include but is not limited to an applet, a socialpublic service account (for example, a subscription, a service account,an official account), a personal account, and the like. In anotherimplementation, in this embodiment of this application, the target usermay independently select the bearer of the search result. For example,the search object window (or another window or interface independent ofthe search object window) further includes an application objectidentifier of at least one result application object. The resultapplication object is used as the bearer of the search result. Forexample, the result application object is an applet or a subscription.The target user selects a target application object identifier in thesearch object window, to indicate that the target user wants to bear thesearch result in a result application object indicated by the targetapplication object identifier. That is, the search result displayed inthe second region of the resource search interface is born in the resultapplication object indicated by the target application objectidentifier. For example, the search result displayed in the secondregion of the resource search interface is born in a target applet (forexample, any applet). That the search result is born in the resultapplication object may mean that search information (the searchinformation is details of the search result) indicated by the searchresult is born in the result application object. That is, the searchinformation indicated by the search result is uploaded to the Internetthrough the result application object. For example, the searchinformation indicated by the search result is an article, and the resultapplication object is an applet. In this case, that the article is bornin the applet may mean that the article is uploaded to the Internetthrough the applet. Then, the applet may be opened to open the article.Certainly, the search object window may further include a search box,and the target user may input a result application object or searchapplication object the user wants in the search box. A specificimplementation of determining the result application object and thesearch application object is not limited in this embodiment of thisapplication.

In summary, in this embodiment of this application, the target user mayindependently select the search application object to perform searchprocessing on the multimedia data, or the target user may independentlyselect the result application object bearing the search result. Thismeets a requirement of a search scenario of the target user, andimproves stickiness of the target user.

S604: Display the resource search interface in response to the selectionoperation performed in the search object window.

S605: Display, in the first region, the at least one search tagassociated with the multimedia data.

S606: Display, in the second region in response to a selection operationon a target tag of the at least one search tag displayed in the firstregion, a search result associated with the target tag.

A specific implementation process of steps S604 and S605 may refer torelated descriptions about a specific implementation process of stepsS202 to S204 in the embodiment shown in FIG. 2 , and will not beelaborated herein.

S607: Trigger, in response to a selection operation on a target searchresult in the search result displayed in the second region, a resultapplication object corresponding to the target search result to displaysearch information of the target search result.

As described above, the result application object may include but is notlimited to an applet, a social public service account (for example, asubscription, a service account, an official account), a personalaccount, and the like. For ease of description, the following uses anexample in which the result application object is an applet fordescription. That is, the result application object is an applet run inthe target application program.

In this embodiment of this application, the search result displayed inthe second region of the resource search interface may be triggered totrigger search information of the search result to be displayed. Thesearch information is details of the search result. In specificimplementations, when the selection operation on the target searchresult (for example, any search result) in the second region of theresource search interface is detected, the result application objectcorresponding to the target search result is triggered, in response tothe selection operation on the target search result, to display thesearch information of the target search result. The search resultdisplayed in the second region includes result prompt information and anapplication object identifier of a result application objectcorresponding to the result prompt information. This helps the targetuser to clearly know about key information (for example, result promptinformation) of each search result and a result application object forbearing the search result.

The following describes, in detail with reference to FIG. 8 , relatedcontent such as the search tag on the resource search interface, thesearch result associated with the target tag, and an implementation oftriggering the search information of the target search result to bedisplayed. As shown in FIG. 8 , related content of the search tag on theresource search interface and the search result associated with thesearch tag may refer to the following description. It is assumed thatthe multimedia data is an image, and a plurality of search tags, forexample, a search tag 1, a search tag 2, and a search tag 3, aredisplayed in the first region of the resource search interface 402. Whenthe target tag (for example, any search tag) in the first region isselected, the target tag may be highlighted in the first region toprompt the target user that the highlighted target tag is in a selectedstate. A highlighting manner may refer to the above description. Inaddition, when the target tag in the first region is selected, thesearch result associated with the target tag may be displayed in thesecond region.

Since a display screen of the target terminal has a limited displayarea, not all search tags associated with the multimedia data may bedisplayed in the first region. Based on this, in this embodiment of thisapplication, when there is a slide event in the first region, a hiddensearch tag is displayed in the first region in a sliding manner. Theslide event may include but is not limited to an event generated in thefirst region by triggering a sliding axis, an event generated in thefirst region by performing a slide operation on the search tag, and thelike. Similarly, not all search results may be displayed in the secondregion. Therefore, a similar or same manner may be used to implementsliding display of the search result in the second region. Elaborationsare omitted herein.

Refer back to FIG. 8 . The search result about the multimedia data isdisplayed in the second region. In some embodiments, search resultsassociated with one or more search tags may be displayed in the secondregion in a mixed manner. For example, the search tag 1, the search tag2, and the search tag 3 are displayed in the first region. In this case,a search result associated with the search tag 1, a search resultassociated with the search tag 2, and a search result associated withthe search tag 3 may be displayed in the second region at the same time.A plurality of search results associated with different or same searchtag may be arranged and displayed in the second region according to apreset rule. The preset rule may include but is not limited to thefollowing.

(1) A chronological order in which the search results are uploaded tothe Internet: for example, the plurality of search results are ranked inan order from early to late time of uploading to the Internet. Forexample, a search result 1 is uploaded to the Internet at 12:00 on April8, a search result 2 is uploaded to the Internet at 17:00 on April 8,and a search result 3 is uploaded to the Internet at 21:00 on April 7.In this case, it is determined that a ranking sequence of the searchresult 1, the search result 2, and the search result 3 in the secondregion is the search result 3→the search result 1→the search result 2.

(2) A popularity of the search result (for example, a click rate, a viewcount, a collection volume, or a playback volume): for example, theplurality of search results are ranked from high to low playback volumesof the search results. For example, a playback volume of a search result1 is 200, a playback volume of a search result 2 is 800, and a playbackvolume of a search result 3 is 250. In this case, it is determined thata ranking sequence of the search result 1, the search result 2, and thesearch result 3 in the second region is the search result 2→the searchresult 3→the search result 1.

(3) A relevance between the search result and a historical browsingbehavior of the target user: the historical browsing behavior of thetarget user may include but is not limited to liking, collecting,playing, and the like of the search result. For example, a view count ofa search result 1 (or a result application object corresponding to thesearch result 1) by the target user in historical duration (for example,24 hours from a current moment (that is, a moment at which the searchresult is triggered to be displayed in the second region)) is 2, a viewcount of a search result 2 (or a result application object correspondingto the search result 2) by the target user in the historical duration is0, and a view count of a search result 3 (or a result application objectcorresponding to the search result 3) by the target user in thehistorical duration is 1. In this case, it is determined that a rankingsequence of the search result 1, the search result 2, and the searchresult 3 in the second region is the search result 1→the search result3→the search result 2.

The above is merely several exemplary preset rules for ranking theplurality of search results. A specific implementation of the presetrule is not limited in this embodiment of this application.

When there is the target tag in the first region, if the target tag isselected by the target user by performing the selection operation on theone or more search tags in the first region, only the search resultassociated with the target tag may be displayed in the second region, orthe search result associated with the target tag is displayed above therest in the second region. For example, if the target tag is the searchtag 1, the search result displayed in the second region may beassociated with the search tag 1. For example, the search result that isdisplayed in the second region and that is associated with the searchtag 1 may include a search result 405, a search result 406, a searchresult 407, and the like. Any search result includes result promptinformation and an application object identifier of a result applicationobject corresponding to the result prompt information. For example, thesearch result 405 includes result prompt information 4051 and anapplication object identifier 4052 of a result application objectcorresponding to the result prompt information 4051. The result promptinformation 4051 may be summary information of the search result 405,and is used for expressing main content of the search result 405 or thelike. The application object identifier 4052 is used for indicating abearer for bearing the search result 405. For example, when indicatingthat the result application object is an applet, the application objectidentifier 4052 is used for prompting the target user that the searchresult is provided by the applet.

Refer back to FIG. 8 . After the selection operation is triggered forthe target search result in the second region, a specific implementationof triggering the search information of the target search result to bedisplayed may refer to the following description. If the search result405 is selected, the target search result is the search result 405. Inthis case, a result application object corresponding to the searchresult 405 is triggered, in response to a selection operation on thesearch result 405, to display search information of the search result405. For example, a search result interface 408 of the resultapplication object is displayed. The search result interface 408includes complete information of the search result 405 corresponding tothe result prompt information 4051. For example, the search result 405is a text, the result prompt information 405 may be a text tile of thetext, and the search result interface 408 includes complete text contentof the text.

A specific style of the search result interface of the resultapplication object and a function of the search result interface may bedefined according to a service requirement of service personnel. In thisembodiment of this application, the search result interface shown inFIG. 8 is used as an example for description, which will not form alimitation on this embodiment of this application. For example, if theresult application object is an applet, a style and a function of asearch result interface of the applet may be customized by a developerof the applet. For example, the result application object supports asharing operation in the search result interface to share the searchresult. In specific implementations, a sharing control is displayed whenthe result application object displays the search information of thetarget search result. The search result interface 408 shown in FIG. 8includes a sharing control 4081. A search identifier corresponding tothe target search result is obtained from the second region in responseto a touch operation on the sharing control 4081. The search identifiermay be used for uniquely identifying the target search result. Thesearch identifier may include a link (for example, a network address) ofthe target search result. The target search result may be accessedthrough the link of the target search result. After the searchidentifier corresponding to the target search result is obtained,sharing processing may be performed on the search identifier. Certainly,a social application program may support sharing of the search result. Aspecific implementation of a sharing operation performed when the socialapplication program supports sharing may refer to the abovedescriptions, and will not be elaborated herein.

The following describes several implementations of sharing processing.For example, in a social conversation scenario, sharing processing mayinclude but is not limited to sharing the target search result to thesocial conversation interface in a social conversation message form. Thesocial conversation interface may be a conversation interface forinitiating a search request for the multimedia data. In thisimplementation, the target user may be helped to fast share the searchresult, the sharing operation may be simplified, and sharing efficiencymay be improved. FIG. 9 is an exemplary schematic diagram of sharing thesearch identifier of the target search result to the social conversationinterface in the social conversation message form. As shown in FIG. 9 ,a social conversation message 901 about the search identifier isdisplayed on the social conversation interface, which may include thesearch identifier of the target search result and an object identifierof the result application object corresponding to the target searchresult. For another example, sharing processing may further includesharing the target search result to a social public service interface(for example, Moments or a feed flow interface). For another example, inaddition to the foregoing sharing the target search result, sharingprocessing may further include sharing the result application objectcorresponding to the target search result. Specifically, the applicationobject identifier of the result application object may be shared. Inthis implementation, sharing processing may include sharing theapplication object identifier of the result application objectcorresponding to the target search result to the social conversationinterface, the social public service interface, or the like. Theforegoing sharing function may be provided by the result applicationobject. Alternatively, the sharing function may be provided by anapplication program (for example, the social application program fordisplaying the social conversation interface) run in the resultapplication object.

In this embodiment of this application, the search operation may beperformed for the multimedia data on the service interface, and theresource search interface may be displayed. The at least one search tagassociated with the multimedia data and the search result associatedwith the target tag are displayed on the resource search interface. Inthe foregoing solution, the search operation may be directly performedfor the multimedia data displayed on the service interface to obtain thesearch tag associated with the multimedia data and the search resultassociated with the target tag. This simplifies a search process of themultimedia data, shortens a search path, and improves the searchefficiency. In addition, the target user may independently select thesearch application object to perform search processing on the multimediadata, or the target user may independently select the result applicationobject carrying the search result. This meets the requirement of thesearch scenario of the target user, and improves the stickiness of thetarget user. Moreover, in this embodiment of this application, sharingprocessing may further be performed on the search result. This can helpthe target user fast share the search result, simplify the sharingoperation, and improve the sharing efficiency.

Based on the above schematic diagram of each interface in the searchprocessing methods shown in FIG. 2 and FIG. 6 , the following describestwo exemplary search processing scenarios by using an example in whichthe multimedia data is an image and the image includes a person elementor a commodity element, to completely describe an implementation processof the search processing method.

(1) The image includes the person element. For example, the image is alive image during livestreaming of a livestreamer. In this case, theperson element in the live image is the livestreamer. In thisimplementation, when search processing is performed on the image, theperson element in the image is mainly recognized. In this way, anobtained search tag associated with the image may indicate the personelement, and a search result associated with the search tag involves aperson indicated by the person element. The following uses an example inwhich the image is the image during livestreaming of the livestreamer tobriefly describe, with reference to FIG. 10 a , an interface process inwhich the search operation for the image is triggered and the searchresult is obtained. As shown in FIG. 10 a , the live image is displayedin a display region of the resource search interface, and at least onesearch tag associated with the live image is displayed in the firstregion. The at least one search tag is related to livestreaming. Forexample, the search tag indicates the livestreamer in the live image.

(2) The image includes the commodity element. For example, the image isa promotion image for commodity marketing. In this case, the promotionimage includes a commodity. In this implementation, when searchprocessing is performed on the promotion image, the commodity, alocation, an icon, and another element in the image are mainlyrecognized. In this way, an obtained search tag associated with thepromotion image may indicate the commodity element. When the image isthe promotion image, a schematic diagram of an interface process inwhich the search operation for the promotion image is triggered and thesearch result is obtained may refer to FIG. 10 b . As shown in FIG. 10 b, the promotion image is displayed in a display region of the resourcesearch interface, and at least one search tag associated with thepromotion image is displayed in the first region. For example, thesearch tag indicates the commodity icon (for example, a logo) in thepromotion image.

The above is merely two exemplary search processing scenarios. It may beunderstood that the search processing scenario may change according todifferent types of the multimedia data (for example, types of elementsin the image). A specific search processing scenario is not limited inthe embodiments of this application.

The foregoing embodiments describe an overall solution process of thesearch processing method provided in the embodiments of thisapplication. The following will describe in detail an overallimplementation process of the embodiments of this application inbackground. The following first briefly describes a search processingsystem with reference to an architectural diagram shown in FIG. 11 a ,to help understand the overall process implemented in background. Asshown in FIG. 11 a , the search processing system includes a firstclient and a server. The first client may be the above-mentioned targetapplication program. The first client is run in the above-mentionedtarget terminal. The server is a background device providing a technicalservice for the target terminal or the first client run in the targetterminal. The server may be an independent physical server, a servercluster or distributed system including a plurality of physical servers,or a cloud server providing a basic cloud computing service such as acloud service, a cloud database, cloud computing, a cloud function,cloud storage, a network service, cloud communication, a middlewareservice, a domain name service, a security service, a content deliverynetwork (CDN), or a big data and artificial intelligence (AI) platform.A quantity and a type of the server are not limited in this embodimentof this application. The target terminal may communicate directly orindirectly with the server. A communication mode is not limited in thisembodiment of this application.

In specific implementations, the first client is configured to transmita data processing request to the server. The data processing requestcarries to-be-processed multimedia data. The server may be configured toreceive the data processing request transmitted by the first client, andperform recognition processing on the multimedia data to obtain at leastone search tag associated with the multimedia data carried in the dataprocessing request. The server is further configured to determine asearch result associated with a target tag according to the target tagin the at least one search tag, and transmit the at least one search tagand the search result associated with the target tag to the firstclient. The first client is further configured to receive the at leastone search tag and the search result associated with the target tag,which are returned by the server, display, in a first region of aresource search interface, the at least one search tag associated withthe multimedia data, and display, in a second region, the search resultassociated with the target tag.

With reference to FIG. 11 a , it can be seen that the server furtherincludes a plurality of modules. For example, the server includes asearch service module, a result recall module, a data processing module,an index module, and an off-line processing module. In this case, theoperations performed by the server may be performed by the plurality ofmodules of the server. The search service module may be configured tointeract with the data processing module to obtain the search tagassociated with the multimedia data. The search service module isfurther configured to interact with the result recall module, and cachethe search result by using an internal memory. In addition, the searchservice module may further be configured to monitor user data such as asearch behavior of a target user, for example, generate a log based onthe user data, for subsequent data analysis. The index module may beconfigured to associatively store a search resource uploaded by aprovider (or a developer) of a result application object and a searchtag corresponding to the search resource. The off-line processing modulemay be configured to obtain the search resource uploaded by the providerof the result application object, and regularly transmit the searchresource to the data processing module to perform recognition processingto obtain the search tag associated with the search resource.

A process in which the server performs the search processing method byusing each module may include the following operations. After the firstclient transmits the data processing request to the server, the servertransmits, through the search service module, the multimedia data to thedata processing module in response to the data processing requesttransmitted by the first client. The server performs, through the dataprocessing module, recognition processing on the multimedia data toobtain the at least one search tag associated with the multimedia data,and performs, through the result recall module, search processingaccording to the target tag to obtain the search result associated withthe target tag. The data processing module may include a recognitioninterface. A recognition algorithm may be called through the recognitioninterface to recognize the multimedia data to obtain the search tagassociated with the multimedia data. That is, in this embodiment of thisapplication, encapsulation of an existing recognition algorithm issupported. In this way, the recognition algorithm may be directly calledthrough the recognition interface provided by the data processing moduleto recognize the multimedia data. Certainly, different types ofrecognition algorithms are for different types of multimedia data. Atype of the recognition algorithm is not limited in this embodiment ofthis application.

In addition, the result recall module may recall the search resultassociated with the target tag from the index module. The index modulestores search resources associated with different search tags. When anysearch tag is used as the target tag, all or some search resourcesassociated with the search tag are used as the search result associatedwith the target tag. Each search resource in the index module isprovided by a provider (or a developer) of a result application object.For example, the result application object is an applet, and the searchresource is provided by a developer of the applet. Specifically, thesearch processing system further includes a second client. The secondclient is the target application program used by a user who logs on toor registers the result application object. An implementation process inwhich the server receives the search resource transmitted by the secondclient may include the following operations. (1) The second client isconfigured to transmit the search resource provided by the resultapplication object to the server. As shown in FIG. 11 a , the secondclient uploads the search resource to the server through a resourceuploading interface provided by the server. (2) After receiving thesearch resource transmitted by the second client, the server may firstperform validity checking on the search resource, and after successfulchecking, transmits the search resource to the off-line processingmodule through the off-line processing module. Validity checking may be:(1) checking whether a data format of the search resource meets a dataformat requirement of the server: for example, a data format of datastored in the server is a file format, and when a format of the uploadedsearch resource is a table format, it is determined that the searchresource does not pass checking, that is, the search resource cannot bestored in local space of a target storage node; (2) checking whether thesearch resource is valid or moralistic data, for example, checkingwhether the search resource includes violent data, false information,and the like, and in response to detecting that the search resourceincludes invalid data or information contrary to morality, determiningthat the search resource does not pass checking; (3) checking whether asource of the search resource conforms to a rule: for example, settingdata stored in the server to all come from a result application objectA, and when the search resource comes from a result application objectB, determining that the search resource does not pass checking, that is,the search resource cannot be stored to the server; and the like. Theabove is merely several exemplary checking manners. A manner in whichthe server checks the search resource is not limited in thisapplication. (3) The server receives, through the data processingmodule, the search resource transmitted by the off-line processingmodule, performs recognition processing on the search resource to obtainthe search tag associated with the search resource, and returns thesearch tag to the off-line processing module. (4) The server transmitsthe search tag and the search resource to the index module through theoff-line processing module, such that the index module associativelystores the search tag and the search resource.

For example, in a process in which the index module associatively storesthe search resource and the search tag associated with the searchresource, it is assumed that the search resource includes a searchresource 1, a search resource 2, and a search resource 3, and after thedata processing module performs recognition processing on each searchresource, a tag associated with the search resource 1 is a tag 1 and atag 2, a tag associated with the search resource 2 is the tag 2 and atag 3, and a tag associated with the search resource 3 is the tag 1 andthe tag 3. In this case, the index module stores the search resource 1and the search resource 3 under an index of the tag 1, stores the searchresource 1 and the search resource 2 under an index of the tag 2, andstores the search resource 2 and the search resource 3 under an index ofthe tag 3. If the target tag is the tag 1, at least one of the searchresource 1 and the search resource 3 under the index of the tag 1 may bedetermined as the search result associated with the target tag.

The above uses an example in which the search service module, the resultrecall module, the data processing module, the index module, and theoff-line processing module are modules of the server for description.However, one or more of the search service module, the result recallmodule, the data processing module, the index module, and the off-lineprocessing module may serve to participate in a search processingprocess as independent devices. For example, the data processing modulemay be a server with a data processing capability. An existence form ofeach module is not limited in this embodiment of this application.

Based on the search processing system shown in FIG. 11 a , the followingmore intuitively describes, with reference to FIG. 11 b , a process inwhich the first client and the server perform the search processingmethod together. As shown in FIG. 11 b , the search processing methodmay include steps s11 to s17.

In s11, the first client generates a data processing request in responseto a search operation triggered for multimedia data on a serviceinterface, the data processing request carrying the to-be-processedmultimedia data.

In s12, the server obtains the data processing request, specificallyreceives the data processing request transmitted by the first client,and performs recognition processing on the multimedia data in responseto the data processing request to obtain at least one search tagassociated with the multimedia data. The server further generates aresponse notification message based on the at least one search tag, theresponse notification message including the at least one search tag.Then, after the server transmits the response notification message tothe first client, the response notification message may be used fortriggering the first client to perform step s13.

In s13, the first client receives the response notification message. Inthis case, the response notification message includes the at least onesearch tag associated with the multimedia data. The first clientdisplays, on a resource search interface according to the responsenotification message, the at least one search tag associated with themultimedia data.

In specific implementations, after receiving the response notificationmessage transmitted by the server, the first client may display, in afirst region of the resource search interface according to the responsenotification message, the at least one search tag associated with themultimedia data.

In an implementation, in addition to one or more search tags, if theresponse notification message further includes a search resultassociated with a target tag in the one or more search tags, in additionto triggering the first client to display the at least one search resultin the first region of the resource search interface, the responsenotification message is further used for triggering the first client todisplay, in a second region of the resource search interface, the searchresult associated with the target tag. The target tag may be determinedfrom the one or more search tags according to a ranking rule. A relateddescription about the ranking rule may refer to the related descriptionin the embodiment shown in FIG. 2 , and is omitted herein. In otherwords, after performing recognition processing on the multimedia data toobtain the at least one search tag, the server may determine the targettag from the at least one search tag, and obtain, through searching, thesearch result associated with the target tag. In this way, the servermay transmit the response notification message including the at leastone search tag and the search result associated with the target tag inthe at least one search tag to the first client, and the first clientmay display, on the resource search interface based on the responsenotification message, both the at least one search tag and the searchresult associated with the target tag. In this implementation, thetarget user may be prompted to some extent to switch to select differentsearch tags on the resource search interface to obtain search resultscorresponding to different search tags.

In s14, the first client generates a search request in response to aselection operation performed on the at least one search tag, the searchrequest including the target tag selected by the selection operationperformed on the at least one search tag, and transmits the searchrequest to the server.

In s15, the server receives the search request transmitted by the firstclient, and performs search processing according to the target tag toobtain the search result associated with the target tag. The servergenerates a result notification message based on the search resultassociated with the target tag, the result notification message beingused for triggering the first client to display, in the second region ofthe resource search interface, the search result associated with thetarget tag.

The following provides an implementation in which each module of theserver performs the foregoing method. Specifically, the server transmitsthe target tag to the result recall module through the search servicemodule. The result recall module performs recall processing according tothe target tag to obtain the search result associated with the targettag. The result recall module returns the search result associated withthe target tag to the search service module, such that the searchservice module transmits the response notification message generatedbased on the search result associated with the target tag to the firstclient.

In some embodiments, the result recall module may recall the searchresult in a multi-path recall manner (that is, recall processing isperformed by using different models, policies, or features). In thiscall, recall is pre-ranking recall. That is, a large quantity of searchresults are recalled. The result recall module further performs rankingprocessing on the large quantity of search results to obtain searchresults arranged in a specific order. In a process in which rankingprocessing is performed on a plurality of search results, the pluralityof search results may be ranked by using the ranking rule. The rankingrule may include but is not limited to ranking according to anassociation degree of the search result and the target tag. For example,a search result corresponding to a high association degree is arrangedbefore or above a search result corresponding to a low associationdegree. The association degree herein may be represented by a pixelvalue of an image element. For example, if a pixel value of a personelement in the image is 20,000, and a pixel value of a hat element is6,000, it is determined that an association degree between the personelement and the image is higher than that between the hat element andthe image. Alternatively, the ranking rule is ranking according to apopularity of the search result in a target time period. The popularitymay be determined by a historical operation on the search result, forexample, tapping, playback, and collection. Alternatively, the rankingrule is ranking the search result according to historical browsing dataof the target user. For example, a click rate of the search result 1 bythe target user in the target time period before a current moment ishigher than that of the search result 2, and it is determined that thesearch result 1 is arranged before or above the search result 2.Alternatively, the ranking rule is another rule.

In steps s11 to s15, an implementation in which the server performsrecognition processing on the multimedia data through each module toobtain the search tag associated with the multimedia data and the searchresult associated with the target tag may include: performing featureanalysis processing on the multimedia data to obtain at least one keyfeature of the multimedia data; establishing a search tag correspondingto the at least one key feature; and then, performing search processingaccording to a target key feature to obtain the search result thatcorresponds to the target key feature and that is associated with thetarget tag. In a process of searching for, according to the target keyfeature, the search result associated with the target tag, search may befirst performed for a result application object associated with thetarget key feature, and then a search resource corresponding to theresult application object is determined as the search result associatedwith the target tag. That is, when the search result is determined, theresult application object associated with the target key feature may befirst determined, and then the search result is determined from thesearch resource corresponding to the result application object.

For example, it is assumed that the target key feature is of a firstfeature type or a second feature type, and the first feature type isdifferent from the second feature type. In a case that the target keyfeature of the multimedia data is of the first feature type, searchprocessing is performed based on the first feature type and the targetkey feature to obtain a search result corresponding to a resultapplication object related to the first feature type; or in a case thatthe target key feature of the multimedia data is of the second featuretype, search processing is performed based on the second feature typeand the target key feature to obtain a search result corresponding to aresult application object related to the second feature type. The resultapplication object related to the first feature type and the resultapplication object related to the second feature type are of differenttypes.

In s16, the first client receives the result notification messagereturned by the server. In this case, the result notification messageincludes the search result associated with the target tag. The firstclient displays, in the second region of the resource search interfaceaccording to the result notification message, the search resultassociated with the target tag.

In s17, the first client calls, in a case that there is a triggeroperation for a target search result, a result application objectcorresponding to the target search result to display search informationof the target search result, the target search result being any one ofthe at least one search result displayed in the second region.

In summary, in this embodiment of this application, searching for themultimedia data may be triggered on the service interface according tointeraction between the first client and the server, to obtain thesearch result associated with the multimedia data. This shortens asearch path, and improves search efficiency.

In the embodiment shown in FIG. 11 a and FIG. 11 b , an example in whichthe data processing module includes the recognition interface and theencapsulated recognition algorithm is called through the recognitioninterface to perform recognition to obtain the search tag of themultimedia data is used. However, in the embodiments of thisapplication, a self-built recognition algorithm is also supported. Inthis implementation, the data processing module of the server has arecognition function. That is, the data processing module is integratedwith a recognition module, and may directly implement recognition of themultimedia data. FIG. 11 c shows an exemplary self-built recognitionalgorithm framework. As shown in FIG. 11 c , the recognition algorithmframework may include, from bottom to top, a data layer, a model layer,a recall layer, and a ranking layer. The data layer may be configured toobtain the search resource uploaded by the provider of the resultapplication object (or the user logging on to the result applicationobject). The model layer may be configured to perform recognitionprocessing on the obtained search resource to obtain a tag associatedwith each search resource, and associatively store the search resourceand the tag associated with the search resource. Specifically, the modellayer may include a plurality of recognition algorithms (for example, asimilar vector (ResNet) algorithm and an optical character recognition(OCR) algorithm). Therefore, the model layer may recognize the searchresource by using one or more of the plurality of recognitionalgorithms. Certainly, when obtaining the to-be-recognized multimediadata, the model layer may perform recognition processing on themultimedia data by using the recognition algorithm to obtain the searchtag associated with the multimedia data. The recall layer may beconfigured to recall, according to the target tag, the search resultassociated with the target tag. The ranking layer may be configured toperform, according to the ranking sequence, ranking processing on theplurality of search results associated with the target tag. The rankingrule herein may include one or more of the following: a learning to rank(L2R) relevance, importance, and the like. Alternatively, the rankingrule may refer to the related content described above.

For different types of multimedia data, different recognition algorithmsare built to recognize the multimedia data. For example, if themultimedia data is an image, recognition processing may be performed onthe image by using an image recognition algorithm to obtain a search tagassociated with the image. The image recognition algorithm may be analgorithm that is obtained through training based on an AI technologysuch as deep learning and massive training data and that provides animage recognition service.

In this embodiment of this application, the encapsulated recognitionalgorithm may be called through the recognition interface to recognizethe multimedia data, or the multimedia data may be recognized by usingthe self-built recognition algorithm, so that methods for recognizingthe multimedia data are enriched. In addition, in this embodiment ofthis application, the search operation may be triggered for themultimedia data on the service interface, and the at least one searchtag associated with the multimedia data and the search result associatedwith the target tag may be displayed on the resource search interface.Directly performing the search operation for the multimedia datadisplayed on the service interface to obtain the search tag associatedwith the multimedia data and the search result associated with thetarget tag simplifies a search process of the multimedia data, shortensa search path, and improves search efficiency.

The foregoing describes the method of the embodiments of thisapplication in detail. For ease of implementing the foregoing solutionof the embodiments of this application, correspondingly, the followingprovides an apparatus of the embodiments of this application.

FIG. 12 is a schematic diagram of a structure of a search processingapparatus according to an exemplary embodiment of this application. Thesearch processing apparatus may be a computer program (including programcode) run in a target terminal. For example, the search processingapparatus may be a target application program (for example, an IMapplication program) in the target terminal. The search processingapparatus may be configured to perform some or all steps in the methodembodiments shown in FIG. 2 and FIG. 6 . Refer to FIG. 12 . The searchprocessing apparatus includes the following units:

-   -   a display unit 1201, configured to display multimedia data on a        service interface; and    -   a processing unit 1202, configured to display a resource search        interface in response to a search operation on the multimedia        data in a service interface, the resource search interface        including a result display region for displaying a search        result, and the result display region including a first region        and a second region.

The display unit 1201 is further configured to display, in the firstregion, at least one search tag associated with the multimedia data.

The processing unit 1202 is further configured to display, in the secondregion in response to a selection operation on a target tag of the atleast one search tag displayed in the first region, a search resultassociated with the target tag.

In an implementation, the service interface is a social conversationinterface. The social conversation interface includes the multimediadata displayed in a social conversation message form.

When configured to display the resource search interface in response tothe search operation on the multimedia data in a service interface, theprocessing unit 1202 is specifically configured to:

-   -   display an option bar on the social conversation interface in        response to a trigger event for the multimedia data on the        social conversation interface, the option bar including a search        option; and    -   determine, in response to detecting a selection operation on the        search option, that the search operation for the multimedia data        is triggered, and display the resource search interface.

In an implementation, the multimedia data includes general informationof the multimedia data. When configured to display the multimedia dataon the service interface, the processing unit 1202 is specificallyconfigured to:

-   -   display the general information of the multimedia data on the        service interface.

In an implementation, the service interface is a content displayinterface. The content display interface includes a search control.

When configured to display the resource search interface in response tothe search operation on the multimedia data in a service interface, theprocessing unit 1202 is specifically configured to:

-   -   display a sharing window in response to a selection operation on        the search control on the content display interface, the sharing        window including a search option; and    -   determine, in response to detecting a selection operation on the        search option, that the search operation for the multimedia data        is triggered, and display the resource search interface.

In an implementation, the multimedia data includes data content of themultimedia data. When configured to display the multimedia data on theservice interface, the processing unit 1202 is specifically configuredto:

-   -   display the data content of the multimedia data on the content        display interface.

In an implementation, the processing unit 1202 is further configured to:

-   -   display a search object window in response to the search        operation on the multimedia data in a service interface, the        search object window including an object identifier of at least        one search application object; and    -   determine, in response to a selection operation performed in the        search object window, M target object identifiers in the object        identifier of the at least one search application object, M        being a positive integer, and trigger search application objects        indicated by the M target object identifiers to perform search        processing.

Search results of search application objects indicated by N targetobject identifiers are displayed on the resource search interface. N isa positive integer less than or equal to M.

In an implementation, each of the at least one search tag displayed inthe first region corresponds to a search application object indicated byone of the M target object identifiers. Search application objectsindicated by different target object identifiers in the M target objectidentifiers correspond to different search tags.

In an implementation, the processing unit 1202 is further configured to:

-   -   trigger, in response to a selection operation on a target search        result in the search result displayed in the second region, a        result application object corresponding to the target search        result to display search information of the target search        result.

The search result displayed in the second region includes result promptinformation and an application object identifier of a result applicationobject corresponding to the result prompt information.

In an implementation, the processing unit 1202 is further configured to:

-   -   display a sharing control in a case that the result application        object displays the search information of the target search        result;    -   obtain, in response to a sharing operation triggered through the        sharing control, a search identifier corresponding to the target        search result, the search identifier being used for uniquely        identifying the target search result, and the search identifier        including a link of the target search result; and    -   perform sharing processing on the search identifier.

In an implementation, the processing unit 1202 is further configured to:

-   -   perform feature analysis processing on the multimedia data to        obtain at least one key feature of the multimedia data;    -   establish a search tag corresponding to the at least one key        feature; and    -   perform search processing according to a target key feature to        obtain the search result associated with the target tag, the        target key feature corresponding to the target tag.

In an implementation, the target key feature is of a first feature typeor a second feature type, and the first feature type is different fromthe second feature type.

The processing unit 1202 is further configured to:

-   -   perform, in a case that the target key feature of the multimedia        data is of the first feature type, search processing based on        the first feature type and the target key feature to obtain a        search result corresponding to a result application object        related to the first feature type; or    -   perform, in a case that the target key feature of the multimedia        data is of the second feature type, search processing based on        the second feature type and the target key feature to obtain a        search result corresponding to a result application object        related to the second feature type.

The result application object related to the first feature type and theresult application object related to the second feature type are ofdifferent types.

In this embodiment of this application, the processing unit 1202responds to the search operation on the multimedia data in a serviceinterface, such that the display unit 1201 displays the resource searchinterface. The at least one search tag associated with the multimediadata and the search result associated with the target tag are displayedon the resource search interface. In the foregoing solution, the searchoperation may be directly triggered for the multimedia data displayed onthe service interface to obtain the search tag associated with themultimedia data and the search result associated with the target tag.This simplifies a search process of the multimedia data, shortens asearch path, and improves the search efficiency.

FIG. 13 is a schematic diagram of a structure of a search processingapparatus according to an exemplary embodiment of this application. Thesearch processing apparatus may be run in a server. The searchprocessing apparatus may be configured to perform some or all steps inthe method embodiment shown in FIG. 11 b . Refer to FIG. 13 . The searchprocessing apparatus includes the following units:

-   -   an obtaining unit 1301, configured to obtain a data processing        request, the data processing request carrying to-be-processed        multimedia data; and    -   a processing unit 1302, configured to perform recognition        processing on the multimedia data to obtain at least one search        tag associated with the multimedia data.

The processing unit 1302 is configured to generate a responsenotification message based on the at least one search tag, the responsenotification message including the at least one search tag.

The processing unit 1302 is configured to transmit the responsenotification message, the response notification message being used fortriggering a first client to display, in a first region of a resourcesearch interface, the at least one search tag associated with themultimedia data.

In an implementation, the processing unit 1302 is further configured to:

-   -   receive a search request, the search request including a target        tag, and the target tag being a search tag selected by        performing a selection operation on the at least one search tag;    -   perform search processing according to the target tag to obtain        a search result associated with the target tag; and    -   generate a result notification message based on the search        result associated with the target tag.

The result notification message is used for triggering the first clientto display, in a second region of the resource search interface, thesearch result associated with the target tag.

In an implementation, the response notification message further includesa search result associated with a target tag in the at least one searchtag. The response notification message is further used for triggeringthe first client to display, in a second region of the resource searchinterface, the search result associated with the target tag.

In an implementation, the server includes a search service module, aresult recall module, and a data processing module. The processing unit1302 is further configured to:

-   -   transmit, through the search service module, the multimedia data        to the data processing module in response to the data processing        request;    -   perform, by using the data processing module, recognition        processing on the multimedia data to obtain the at least one        search tag associated with the multimedia data; and    -   perform, through the result recall module, search processing        according to the target tag to obtain the search result        associated with the target tag.

In an implementation, the server includes an off-line processing moduleand an index module. The processing unit 1302 is further configured to:

-   -   receive a to-be-stored search resource, the search resource        being provided by a provider of a result application object;        transmit the search resource to the data processing module        through the off-line processing module, the data processing        module being configured to perform recognition processing on the        multimedia data to obtain the at least one search tag associated        with the multimedia data;    -   perform recognition processing on the received search resource        by using the data processing module to obtain a search tag        associated with the search resource, and return the search tag        associated with the search resource to the off-line processing        module;    -   transmit the search tag associated with the search resource and        the search resource to the index module through the off-line        processing module; and    -   store the search tag associated with the search resource and the        search resource associatively by using the index module.

According to an embodiment of this application, each unit in the searchprocessing apparatuses shown in FIG. 12 and FIG. 13 may existrespectively or be combined into one or more other units. Alternatively,a certain (or some) unit in the units may be further split into aplurality of smaller function units, thereby implementing the sameoperations without affecting the technical effects of the embodiments ofthis application. The units are divided based on logical functions. Inactual applications, a function of one unit may be realized by multipleunits, or functions of a plurality of units may be realized by one unit.In another embodiment of this application, the search processingapparatus may further include other units. In actual applications, thesefunctions may also be realized cooperatively by the other units, and maybe realized cooperatively by multiple units. According to anotherembodiment of this application, a computer program (including programcode) capable of performing each step involved in the correspondingmethod shown in FIG. 11 b may be run in a general-purpose computingdevice, for example, a computer, including a processing element and astorage element, for example, a central processing unit (CPU), a randomaccess memory (RAM), or a read-only memory (ROM), to structure thesearch processing apparatus shown in FIG. 12 or FIG. 13 and implementthe search processing method in the embodiments of this application. Thecomputer program may be recorded in, for example, a non-transitorycomputer-readable recording medium and loaded, through thecomputer-readable recording medium, and run in the computing device.

In this embodiment of this application, the search operation may bedirectly triggered for the multimedia data displayed on the serviceinterface to obtain the search tag associated with the multimedia dataand the search result associated with the target tag. This simplifies asearch process of the multimedia data, shortens a search path, andimproves the search efficiency.

FIG. 14 is a schematic diagram of a structure of a computer deviceaccording to an exemplary embodiment of this application. Refer to FIG.14 . The computer device includes a processor 1401, a communicationinterface 1402, and a non-transitory computer-readable storage medium1403. The processor 1401, the communication interface 1402, and thecomputer-readable storage medium 1403 may be connected through a bus orin another manner. The communication interface 1402 is configured toreceive and send data. The computer-readable storage medium 1403 may bestored in a memory of the computer device. The computer-readable storagemedium 1403 is configured to store a computer program. The computerprogram includes program instructions. The processor 1401 is configuredto execute the program instructions stored in the computer-readablestorage medium 1403. As a computing core and a control core of thecomputer device, the processor 1401 (or referred to as a CPU) issuitable for implementing one or more instructions, specificallysuitable for loading and executing the one or more instructions, therebyimplementing corresponding method processes or corresponding functions.

An embodiment of this application also provides a non-transitorycomputer-readable storage medium (memory). As a memory device in thecomputer device, the computer-readable storage medium is configured tostore a program and data. It may be understood that thecomputer-readable storage medium herein may include a built-in storagemedium in the computer device, or may certainly include an extendedstorage medium supported by the computer device. The computer-readablestorage medium provides storage space storing a processing system of thecomputer device. Moreover, one or more instructions suitable for theprocessor 1401 to load and execute are also stored in the storage space,and these instructions may be one or more computer programs (includingprogram code). The computer-readable storage medium herein may be ahigh-speed RAM, or a non-volatile memory, for example, at least one diskmemory. In some embodiments, the computer-readable storage medium may beat least one computer-readable storage medium far away from theprocessor.

In an embodiment, the computer device may be the target terminalmentioned in the foregoing embodiments. One or more instructions arestored in the computer-readable storage medium. The processor 1401 loadsand executes the one or more instructions stored in thecomputer-readable storage medium, so as to implement the correspondingsteps in the embodiment of the search processing method. In specificimplementations, the one or more instructions in the computer-readablestorage medium are loaded and executed by the processor 1401 toimplement any foregoing search processing method performed by the targetterminal.

In another embodiment, the computer device may be the server mentionedin the foregoing embodiments. One or more instructions are stored in thecomputer-readable storage medium. The processor 1401 loads and executesthe one or more instructions stored in the computer-readable storagemedium, so as to implement the corresponding steps in the embodiment ofthe search processing method. In specific implementations, the one ormore instructions in the computer-readable storage medium are loaded andexecuted by the processor 1401 to implement any foregoing searchprocessing method performed by the server.

An embodiment of this application also provides a computer programproduct or computer program. The computer program product or computerprogram includes computer instructions. The computer instructions arestored in a computer-readable storage medium. A processor of a computerdevice reads the computer instructions from the computer-readablestorage medium. The computer instructions are executed by the processorto implement the foregoing search processing method.

A person of ordinary skill in the art may realize that the units and thealgorithm steps in each example described in combination with theembodiments disclosed in this application may be implemented byelectronic hardware or a combination of computer software and electronichardware. Whether these functions are executed by hardware or softwaredepends on specific applications and design constraints of the technicalsolutions. A person skilled in the art may use different methods toimplement the described functions for each particular application, butit is not to be considered that such implementation goes beyond thescope of this application.

All or some of the foregoing embodiments may be implemented by usingsoftware, hardware, firmware, or any combination thereof. When softwareis used to implement the embodiments, all or some of the embodiments maybe implemented in a form of a computer program product. The computerprogram product includes one or more computer instructions. When thecomputer program instructions are loaded and executed on the computer,the processes or functions according to embodiments of this applicationare all or partially generated. The computer may be a general-purposecomputer, a dedicated computer, a computer network, or anotherprogrammable device. The computer instruction may be stored in acomputer-readable storage medium or transmitted through thecomputer-readable storage medium. The computer instruction may betransmitted from one website, computer, server, or data center toanother in a wired (for example, a coaxial cable, an optical fiber, or adigital subscriber line (DSL)) or wireless (for example, infrared,radio, or microwave) manner. The computer-readable storage medium may beany available medium accessible by a computer, or a data storage device,such as a server or a data center, integrating one or more availablemedia. The available medium may be a magnetic medium (for example, afloppy disk, a hard disk, or a magnetic tape), an optical medium (forexample, a digital video disk (DVD)), a semiconductor medium (forexample, a solid state disk (SSD)), or the like.

The foregoing descriptions are merely specific implementations of thisapplication, but are not intended to limit the protection scope of thisapplication. Any variation or replacement apparent to a person skilledin the art within the technical scope disclosed in this applicationshall fall within the protection scope of this application. Therefore,the protection scope of this application shall be subject to theprotection scope of the claims.

In this application, the term “unit” or “module” in this applicationrefers to a computer program or part of the computer program that has apredefined function and works together with other related parts toachieve a predefined goal and may be all or partially implemented byusing software, hardware (e.g., processing circuitry and/or memoryconfigured to perform the predefined functions), or a combinationthereof. Each unit or module can be implemented using one or moreprocessors (or processors and memory). Likewise, a processor (orprocessors and memory) can be used to implement one or more modules orunits. Moreover, each module or unit can be part of an overall modulethat includes the functionalities of the module or unit

What is claimed is:
 1. A search processing method performed by acomputer device, the method comprising: displaying a resource searchinterface in response to a search operation on multimedia data in aservice interface, the resource search interface comprising a firstregion and a second region; displaying, in the first region, at leastone search tag associated with the multimedia data; and displaying, inthe second region in response to a selection operation on a target tagof the at least one search tag displayed in the first region, a searchresult associated with the target tag.
 2. The method according to claim1, wherein the service interface is a social conversation interface, andthe social conversation interface comprises the multimedia datadisplayed in a social conversation message form; and the displaying aresource search interface in response to a search operation on themultimedia data in a service interface comprises: displaying an optionbar on the social conversation interface in response to a trigger eventfor the multimedia data on the social conversation interface, the optionbar comprising a search option; and determining, in response todetecting a selection operation on the search option, that the searchoperation for the multimedia data is triggered, and displaying theresource search interface.
 3. The method according to claim 1, whereinthe multimedia data comprises general information of the multimediadata; and the displaying multimedia data on a service interfacecomprises: displaying the general information of the multimedia data onthe service interface.
 4. The method according to claim 1, wherein theservice interface is a content display interface; the content displayinterface comprises a search control; and the displaying a resourcesearch interface in response to a search operation on the multimediadata in a service interface comprises: displaying a sharing window inresponse to a selection operation on the search control on the contentdisplay interface, the sharing window comprising a search option; anddetermining, in response to detecting a selection operation on thesearch option, that the search operation for the multimedia data istriggered, and displaying the resource search interface.
 5. The methodaccording to claim 1, before the displaying a resource search interface,further comprising: displaying a search object window in response to thesearch operation on the multimedia data in a service interface, thesearch object window comprising an object identifier of at least onesearch application object; and determining, in response to a selectionoperation performed in the search object window, M target objectidentifiers in the object identifier of the at least one searchapplication object, M being a positive integer, and triggering searchapplication objects indicated by the M target object identifiers toperform search processing, search results of search application objectsindicated by N target object identifiers being displayed on the resourcesearch interface, and N being a positive integer less than or equal toM.
 6. The method according to claim 1, wherein the method furthercomprises: triggering, in response to a selection operation on a targetsearch result in the search result displayed in the second region, aresult application object corresponding to the target search result todisplay search information of the target search result, the searchresult displayed in the second region comprising result promptinformation and an application object identifier of a result applicationobject corresponding to the result prompt information.
 7. The methodaccording to claim 1, wherein before the displaying a resource searchinterface, the method further comprises: performing feature analysisprocessing on the multimedia data to obtain at least one key feature ofthe multimedia data; establishing a search tag corresponding to the atleast one key feature; and performing search processing according to atarget key feature to obtain the search result associated with thetarget tag, the target key feature corresponding to the target tag.
 8. Acomputer device, comprising: a processor, configured to execute acomputer program; and a computer-readable storage medium, thecomputer-readable storage medium storing the computer program that, whenexecuted by the processor, causes the computer device to implement asearch processing method including: displaying a resource searchinterface in response to a search operation on multimedia data in aservice interface, the resource search interface comprising a firstregion and a second region; displaying, in the first region, at leastone search tag associated with the multimedia data; and displaying, inthe second region in response to a selection operation on a target tagof the at least one search tag displayed in the first region, a searchresult associated with the target tag.
 9. The computer device accordingto claim 8, wherein the service interface is a social conversationinterface, and the social conversation interface comprises themultimedia data displayed in a social conversation message form; and thedisplaying a resource search interface in response to a search operationon the multimedia data in a service interface comprises: displaying anoption bar on the social conversation interface in response to a triggerevent for the multimedia data on the social conversation interface, theoption bar comprising a search option; and determining, in response todetecting a selection operation on the search option, that the searchoperation for the multimedia data is triggered, and displaying theresource search interface.
 10. The computer device according to claim 8,wherein the multimedia data comprises general information of themultimedia data; and the displaying multimedia data on a serviceinterface comprises: displaying the general information of themultimedia data on the service interface.
 11. The computer deviceaccording to claim 8, wherein the service interface is a content displayinterface; the content display interface comprises a search control; andthe displaying a resource search interface in response to a searchoperation on the multimedia data in a service interface comprises:displaying a sharing window in response to a selection operation on thesearch control on the content display interface, the sharing windowcomprising a search option; and determining, in response to detecting aselection operation on the search option, that the search operation forthe multimedia data is triggered, and displaying the resource searchinterface.
 12. The computer device according to claim 8, wherein, beforethe displaying a resource search interface, the method furthercomprises: displaying a search object window in response to the searchoperation on the multimedia data in a service interface, the searchobject window comprising an object identifier of at least one searchapplication object; and determining, in response to a selectionoperation performed in the search object window, M target objectidentifiers in the object identifier of the at least one searchapplication object, M being a positive integer, and triggering searchapplication objects indicated by the M target object identifiers toperform search processing, search results of search application objectsindicated by N target object identifiers being displayed on the resourcesearch interface, and N being a positive integer less than or equal toM.
 13. The computer device according to claim 8, wherein the methodfurther comprises: triggering, in response to a selection operation on atarget search result in the search result displayed in the secondregion, a result application object corresponding to the target searchresult to display search information of the target search result, thesearch result displayed in the second region comprising result promptinformation and an application object identifier of a result applicationobject corresponding to the result prompt information.
 14. The computerdevice according to claim 8, wherein, before the displaying a resourcesearch interface, the method further comprises: performing featureanalysis processing on the multimedia data to obtain at least one keyfeature of the multimedia data; establishing a search tag correspondingto the at least one key feature; and performing search processingaccording to a target key feature to obtain the search result associatedwith the target tag, the target key feature corresponding to the targettag.
 15. A non-transitory computer-readable storage medium storing acomputer program that, when executed by a processor of a computerdevice, causes the computer device to implement a search processingmethod including: displaying a resource search interface in response toa search operation on multimedia data in a service interface, theresource search interface comprising a first region and a second region;displaying, in the first region, at least one search tag associated withthe multimedia data; and displaying, in the second region in response toa selection operation on a target tag of the at least one search tagdisplayed in the first region, a search result associated with thetarget tag.
 16. The non-transitory computer-readable storage mediumaccording to claim 15, wherein the service interface is a socialconversation interface, and the social conversation interface comprisesthe multimedia data displayed in a social conversation message form; andthe displaying a resource search interface in response to a searchoperation on the multimedia data in a service interface comprises:displaying an option bar on the social conversation interface inresponse to a trigger event for the multimedia data on the socialconversation interface, the option bar comprising a search option; anddetermining, in response to detecting a selection operation on thesearch option, that the search operation for the multimedia data istriggered, and displaying the resource search interface.
 17. Thenon-transitory computer-readable storage medium according to claim 15,wherein the multimedia data comprises general information of themultimedia data; and the displaying multimedia data on a serviceinterface comprises: displaying the general information of themultimedia data on the service interface.
 18. The non-transitorycomputer-readable storage medium according to claim 15, wherein theservice interface is a content display interface; the content displayinterface comprises a search control; and the displaying a resourcesearch interface in response to a search operation on the multimediadata in a service interface comprises: displaying a sharing window inresponse to a selection operation on the search control on the contentdisplay interface, the sharing window comprising a search option; anddetermining, in response to detecting a selection operation on thesearch option, that the search operation for the multimedia data istriggered, and displaying the resource search interface.
 19. Thenon-transitory computer-readable storage medium according to claim 15,wherein, before the displaying a resource search interface, the methodfurther comprises: displaying a search object window in response to thesearch operation on the multimedia data in a service interface, thesearch object window comprising an object identifier of at least onesearch application object; and determining, in response to a selectionoperation performed in the search object window, M target objectidentifiers in the object identifier of the at least one searchapplication object, M being a positive integer, and triggering searchapplication objects indicated by the M target object identifiers toperform search processing, search results of search application objectsindicated by N target object identifiers being displayed on the resourcesearch interface, and N being a positive integer less than or equal toM.
 20. The computer device according to claim 8, wherein, before thedisplaying a resource search interface, the method further comprises:performing feature analysis processing on the multimedia data to obtainat least one key feature of the multimedia data; establishing a searchtag corresponding to the at least one key feature; and performing searchprocessing according to a target key feature to obtain the search resultassociated with the target tag, the target key feature corresponding tothe target tag.